Adding files to deploy DocSum application on ROCm vLLM#1572
Adding files to deploy DocSum application on ROCm vLLM#1572chensuyue merged 149 commits intoopea-project:mainfrom
Conversation
Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
Dependency Review✅ No vulnerabilities or license issues found.Scanned Files |
for more information, see https://pre-commit.ci
Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
…into feature/Docsum_vLLM # Conflicts: # .github/workflows/_example-workflow.yml # AgentQnA/README.md # AgentQnA/docker_compose/intel/cpu/xeon/README.md # AgentQnA/docker_compose/intel/cpu/xeon/compose_openai.yaml # AgentQnA/docker_compose/intel/cpu/xeon/launch_agent_service_openai.sh # AgentQnA/docker_compose/intel/hpu/gaudi/README.md # AgentQnA/docker_compose/intel/hpu/gaudi/launch_agent_service_gaudi.sh # AgentQnA/tests/step4_launch_and_validate_agent_gaudi.sh # AgentQnA/tests/test_compose_on_gaudi.sh # AudioQnA/docker_image_build/build.yaml # ChatQnA/docker_compose/intel/hpu/gaudi/compose.telemetry.yaml # ChatQnA/docker_compose/intel/hpu/gaudi/compose_tgi.telemetry.yaml # ChatQnA/docker_compose/intel/hpu/gaudi/set_env.sh
for more information, see https://pre-commit.ci
Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
I fixed errors related to missing variables and encountered an error again. - failed to solve: opea/comps-base:ci: failed to resolve source metadata for docker.io/opea/comps-base:ci: docker.io/opea/comps-base:ci: not found |
Please see my comments inline. |
Signed-off-by: Chingis Yundunov <[email protected]>
…tamonsters/OPEA-GenAIExamples into feature/Docsum_vLLM # Conflicts: # DocSum/docker_compose/amd/gpu/rocm/README.md # DocSum/docker_compose/amd/gpu/rocm/compose.yaml # DocSum/docker_compose/amd/gpu/rocm/compose_vllm.yaml # DocSum/tests/test_compose_on_rocm.sh # DocSum/tests/test_compose_vllm_on_rocm.sh
…into feature/Docsum_vLLM # Conflicts: # DocSum/docker_compose/amd/gpu/rocm/README.md # DocSum/docker_compose/amd/gpu/rocm/set_env.sh # DocSum/docker_image_build/build.yaml # DocSum/tests/test_compose_on_rocm.sh
Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
…into feature/Docsum_vLLM
Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
…into feature/Docsum_vLLM
Signed-off-by: Chingis Yundunov <[email protected]>
for more information, see https://pre-commit.ci
…1572) Signed-off-by: Chingis Yundunov <[email protected]> Signed-off-by: Chingis Yundunov <[email protected]>
…1572) Signed-off-by: Chingis Yundunov <[email protected]> Signed-off-by: cogniware-devops <[email protected]>
Description
Adding files to deploy DocSum application on ROCm vLLM.
Issues
It is required to provide the ability to deploy the DocSum application on ROCm vLLM
Type of change
Dependencies
Tests
Testing was performed manually and by running a script DocSum/tests/test_compose_vllm_on_rocm.sh This script is similar to the script that runs DocSum testing on an Intel CPU.